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ABSTRACT 

We  present  a  rigorous  treatment  of  coalition  formation  based  on  trust  interactions  in  multi-agent  systems.  Current 
literature  on  trust  in  multi-agent  systems  primarily  deals  with  trust  models  and  protocols  of  interaction  in  non- 
cooperative  scenarios.  Here,  we  use  cooperative  game  theory  as  the  underlying  mathematical  framework  to  study  the 
trust  dynamics  between  agents  as  a  result  of  their  trust  synergy  and  trust  liability  in  cooperative  coalitions.  We  rigorously 
justify  the  behaviors  of  agents  for  different  classes  of  games,  and  discuss  ways  to  exploit  the  formal  properties  of  these 
games  for  specific  applications,  such  as  unmanned  cooperative  control. 
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1.  INTRODUCTION 

The  concept  of  trust  is  something  people  intuitively  understand,  but  might  find  difficultly  grasping  rationally.  People 
rely  on  trust  whenever  they  need  to  gauge  something  they  cannot  ever  know  precisely  with  reasonable  time  or  effort. 
But  this  reliance  exposes  them  to  vulnerabilities  associated  with  betrayal.  So,  on  one  hand,  trust  can  be  used  as  highly 
versatile  heuristic  that  deals  with  uncertainty  by  reducing  the  complexity  of  expectations  within  arbitrary  situations 
involving  risk,  vulnerability,  and  interdependence1.  On  the  other  hand,  the  motivation  for  trust  -  the  need  to  believe  that 
things  will  behave  consistently  -  exposes  individuals  to  potentially  undesirable  outcomes. 

Trust  is  clearly  a  “double-edged  sword,”  but  its  importance  in  military  contexts  is  evident.  Currently,  the  United  States 
military  wages  asymmetric  battles  against  insurgencies  in  Southwest  Asia,  where  enemy  combatants  have  exhibited 
quick  and  deadly  adaptations  to  US  strategies  and  tactics2.  One  of  these  deadly  adaptations  has  been  the  use  of 
improvised  explosive  devices  (IEDs).  Early  in  the  Iraq  and  Afghanistan  war  efforts,  IEDs  were  jury-rigged  homemade 
bombs  that,  while  deadly,  could  be  avoided  with  increased  awareness.  But  insurgents  quickly  adapted  by  developing 
more  sophisticated  explosives,  often  with  timing  devices,  pressure  switches,  and  even  wireless  triggers.  In  addition, 
insurgents  became  more  difficult  to  detect  due  to  their  knowledge  of  the  local  terrain  and  their  ability  to  mix  with 
civilian  populations.  Responses  to  more  advanced  IED  attacks  required  Soldiers  to  put  more  of  their  trust  into  new 
equipment  (such  as  up-armor  vehicles,  electronic  jammers,  and  robots)  as  well  as  local  allies.  And  while  this  did  not 
imply  that  any  Soldier  was  any  safer  than  before,  the  trust  helped  Soldiers  deal  internally  with  wartime  uncertainties  so 
that  they  could  continue  their  duties  and  focus  on  mission  objectives. 

The  need  for  trust  in  extreme  military  situations  is  obvious;  but  what  may  not  be  as  obvious  is  the  effect  of  trust  on  more 
ordinary  military  interactions.  Trust  impacts  a  range  of  social  processes  between  Soldiers  that  influence  the  cognitive 
and  physical  strain  of  being  at  war.  When  the  trust  of  a  Soldier  becomes  lower  toward  other  people,  equipment,  or 
processes,  then  he  will  likely  need  to  exert  more  effort  in  order  to  resolve  any  perceived  uncertainties.  This  extra  effort 
could  manifest  itself  into  a  distraction  that  lowers  the  effectiveness  of  the  Soldier  at  best.  However,  in  prolonged  high 
stress  situations,  this  additional  effort  could  also  manifest  itself  as  a  persistently  guarded  psychological  state  that 
monitors  for  violations  of  expectations  and  predictions. 
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Trust  can,  therefore,  be  seen  as  critical  survival  tool  for  Soldiers  dealing  with  uncertainty,  whether  in  combat  or  not.  The 
effect  of  high  trust  in  military  settings  can  lessen  the  defensive  monitoring  of  others,  reduce  in  the  need  for  hierarchical 
control,  improve  cooperation  due  to  increased  predictability  and  expectations  of  reciprocity,  improve  information 
sharing  (with  less  need  to  filter  unfavorable  information),  lower  levels  of  conflict  (friction  and  dissent),  and  improve 
group  performance  and  processes3.  Our  goal  here  then  is  to  determine  a  way  to  incorporate  elements  of  trust  into 
machine-based  agents  in  an  effort  to  realize  similar  emergent  efficiencies,  such  as  lower  power  consumption,  faster 
algorithms,  and  the  exchange  of  higher-quality  information.  We  hypothesize  that  machines  with  an  ability  to  accurately 
evaluate  trustworthiness  in  other  agents  will  be  able  to  use  this  knowledge  to  intelligently  select  better  partners  for 
cooperative  activities  and  achieve  greater  cooperative  payoffs  over  time.  Therefore,  in  this  paper,  we  develop  a 
theoretical  framework  for  coalition  formation  based  on  trust  interactions  in  multi-agent  systems.  Then,  we  show  how  the 
theory  could  be  applied  to  a  military  unmanned  system  -  specifically  the  unmanned  military  convoy. 

2.  REVIEW  OF  MULTI-AGENT  TRUST  RESEARCH 

This  section  briefly  highlights  prior  work  in  multi-agent  trust  research  and  intends  to  present  a  broad  range  of  possible 
multi-agent  trust  approaches.  For  an  extensive  survey  of  trust  research  in  multi-agent  systems  up  to  2004,  we  urge  the 
reader  to  examine  the  paper  by  Ramchurn,  Huynh,  and  Jennings4.  We  borrow  their  classification  of  multi-agent  trust 
approaches  -  trust  models  and  protocols  of  interaction  -  to  present  both  long-standing  and  recent  findings. 

2.1  Trust  Models 

Trust  models  give  agents  the  ability  to  reason  about  the  reciprocity,  honesty,  and  reliability  of  other  agents.  Since  agents 
in  a  system  are  always  assumed  to  have  selfish  interests,  these  models  take  the  viewpoint  of  an  agent  trying  to  find  the 
most  reliable  interaction  agents  from  a  pool  of  potential  agents. 

Some  trust  model  research  attempts  to  characterize  trust  within  non-cooperative  scenarios.  Sen  demonstrates  how 
reciprocity  can  emerge  when  agents  learn  to  predict  the  value  of  future  benefits  when  competitive  agents  cooperate5. 
Mukherjee,  Banerjee,  and  Sen  show  how  trust  can  be  acquired  if  agents  know  their  opponents  chosen  move  in  advance6. 
Castelfranchi  and  Falcone  assert  that  socio-cognitive  models  which  incorporate  beliefs  in  competence,  willingness, 
persistence,  and  motivation  are  essential  to  determine  the  amount  of  trust  each  agent  can  place  in  other  agents7'8'9. 

Other  work  in  trust  models  factor  in  evidence  to  justify  trust  values.  Witkowski,  Artikis,  and  Pitt  propose  a  model 
whereby  trust  is  based  on  performance  in  past  interactions10.  Sabater  and  Sierra,  through  the  REGRET  system,  attribute 
fuzziness  to  the  notion  of  performance  and  adopte  a  sociological  approach  to  reputation  by  using  a  weighted  sum  of 
subjective  impressions11.  Teacy,  Patel,  Jennings,  and  Luck  develop  a  probabilistic  trust  model  in  terms  of  confidence 
that  expected  values  lie  within  specific  error  tolerances12.  Theodorakopoulos  and  Baras  focus  on  evaluating  trust 
evidence  in  ad  hoc  networks  using  the  theory  of  semirings13.  Wang  and  Singh  define  trust  in  terms  of  belief  and 
certainty,  and  formulate  certainty  in  terms  of  evidence  based  on  a  statistical  measure  defined  over  a  probability 
distribution  of  positive  outcome  probabilities14. 

Some  work  also  incorporates  trust  models  into  specific  applications.  Abdul-Rahman  and  Hailes  attempt  to  use  social 
trust  characteristics  and  word-of-mouth  to  calculate  trust  in  virtual  environments15.  Zhang,  Das,  and  Liu  present  a 
framework  to  secure  data  aggregation  against  false  data  injection  in  wireless  sensor  networks  that  exploits  redundancy  in 
gathered  data  to  evaluate  the  trustworthiness  of  each  sensor16.  Ballal  and  Lewis  discuss  the  concept  of  trust  consensus 
for  collaborative  control  and  show  how  the  propagation  of  trust  through  a  network  can  lead  to  a  global  asymptotic  trust 
consensus  among  all  agents17. 

2.2  Protocols  of  Interaction 

Whereas  trust  models  are  intended  to  build  trust  at  the  agent-level,  protocols  of  interaction  are  intended  to  build  trust  at 
the  system-level.  In  short,  they  are  developed  to  make  sure  agents  will  gain  some  utility  if  they  follow  the  rules  -  and 
lose  utility  if  they  don’t.  Thus,  the  rules  of  a  system  enable  an  agent  to  trust  other  agents  by  the  virtue  of  the  different 
constraints  in  a  system. 

Multi-agent  trust  protocols  can  be  divided  into  three  main  groups:  truth-eliciting,  reputation  mechanisms,  and  security 
mechanisms.  Truth-eliciting  protocols  force  agents  to  follow  the  rules,  which  dictate  the  individual  steps  in  interactions 
and  the  information  revealed  by  the  agents  during  interactions.  By  doing  so,  agents  should  find  no  better  option  than 
telling  the  truth.  The  Vickrey-Clarke-Groves  (VCG)  mechanisms  are  an  example  of  protocols  that  enforce  truth¬ 
telling18.  Reputation  mechanisms  force  agents  to  interact  with  some  trusted  authority  to  get  public  ratings  on  other 


agents  in  a  system.  Zacharia  and  Maes  outlined  some  basic  requirements  for  practical  reputation  mechanisms19.  For 
security  in  agent  networks,  trust  is  used  to  describe  the  fact  that  an  agent  can  prove  who  they  say  they  are.  Poslad, 
Calisti,  and  Charlton  proposed  that  identity,  access  permissions,  content  integrity,  and  content  privacy  are  essential  for 
agents  to  trust  each  other  and  each  other's  messages  transmitted  across  a  network’0.  These  requirements  are  specified  in 
the  Foundation  for  Intelligent  Physical  Agents  (FIPA)  abstract  architecture  and  implemented  by  public  key  encryption 
(PGP  and  X.509)  and  a  certificate  infrastructure21. 

3.  CLASSES  OF  TRUST  GAMES 

This  section  characterizes  different  classes  of  trust  games  within  the  context  of  cooperative  game  theory.  Our 
characterizations  provide  the  necessary  conditions  for  a  coalition  trust  game  to  be  classified  into  a  particular  class.  We 
start  with  additive  and  constant-sum  trust  games,  which  have  limited  value  for  cooperative  applications,  but  are  included 
for  completeness.  Then,  we  discuss  superadditive  and  convex  trust  games,  and  show  the  necessary  conditions  for  agents 
to  form  a  grand  coalition.  In  general,  grand  coalition  solution  concepts  presented  here  can  also  be  applied  to  smaller 
coalitions  within  a  trust  game  through  the  use  of  a  trust  subgame. 

3.1  Preliminaries 

Cooperative  game  theory  focuses  on  what  groups  of  self-interested  agents  can  achieve.  It  is  not  concerned  with  how 
agents  make  choices  or  coordinate  in  coalitions,  and  does  not  assume  that  agents  will  always  agree  to  follow  arbitrary 
instructions.  Rather,  cooperative  game  theory  defines  games  that  tell  how  well  a  coalition  can  do  for  itself22.  And  while 
the  coalition  is  the  basic  modeling  unit  for  coalition  game,  the  theory  supports  modeling  individual  agent  preferences 
without  concern  for  their  possible  actions.  As  such,  it  is  an  ideal  framework  for  modeling  trust-based  coalition 
formation  since  it  can  show  how  each  agent’s  trust  preferences  can  influence  a  group’s  ability  to  reason  about 
trustworthiness.  In  essence,  cooperative  game  theory  allows  us  to  blend  the  reasoning  abilities  of  agent-level  trust 
models  with  the  system-level  benefits  of  trust  interaction  protocols,  forming  a  general  concept  of  system-level  reasoning. 

Definition:  Let  Y  —  (N ,  v)  be  a  coalitional  trust  game  with  transferable  utility  where: 

•  N  is  a  finite  set  of  agents,  indexed  by  i 

•  v.  2n  -»  M  associates  with  each  coalition  S  £  N  a  real-valued  payoff  v(5)  that  is  distributed  between  the 
agents.  Singleton  coalitions,  by  definition,  are  assigned  no  value;  i.e.  v(i )  =  0  Vi  £  N . 

The  transferable  utility  assumption  means  that  payoffs  in  a  coalition  may  be  freely  distributed  among  its  members.  With 
regards  to  payoff  value  of  trust  between  agents,  this  assumption  can  be  interpreted  as  a  universal  means  for  agents  to 
mutually  share  the  value  of  their  trustworthy  relationships.  Trust  cultivation  often  requires  reciprocity  between  two 
agents  as  a  necessary  behavior  to  develop  trust,  and  a  transferable  utility  is  a  convenient  way  to  model  the  exchange  for 
this  notion. 

In  defining  a  transferable  payoff  value  of  trust,  one  aspect  to  consider  are  the  “goods  of  trust”.  These  refer  to 
opportunities  for  cooperative  activity,  knowledge,  and  autonomy.  In  this  paper,  we  refer  to  these  goods  as  trust  synergy 
s(S),  which  is  a  trust-based  result  that  could  not  be  obtained  independently  by  two  or  more  agents.  We  may  also 
interpret  trust  synergy  as  the  value  obtained  by  agents  in  a  coalition  as  a  result  of  being  able  to  work  together  due  to  their 
attitudes  of  trust  for  each  other.  In  defining  a  set  function  for  trust  synergy,  it  is  important  to  explicitly  show  how  each 
agent’s  attitude  of  trustworthiness  for  every  other  agent  in  a  coalition  affects  this  synergy.  In  general,  higher  levels  of 
trust  in  a  coalition  should  produce  higher  levels  of  synergy. 

The  payoff  value  of  trust,  however,  also  includes  an  opposing  force  in  the  form  of  vulnerability  exposure,  which  we  refer 
to  as  trust  liability  l(Sy  Trusting  involves  being  optimistic  that  the  trustee  will  do  something  for  the  truster;  and  this 
optimism  is  what  causes  the  vulnerability,  since  it  restricts  the  inferences  a  truster  makes  about  the  likely  actions  of  the 
trustee.  Flowever,  the  refusal  to  be  vulnerable  tends  to  undermine  trust  since  it  does  not  allow  others  to  prove  their  own 
trustworthiness,  stifling  growth  in  trust  synergy.  Thus,  we  see  that  agents  in  trust-based  relationships  with  other  agents 
must  be  aware  of  the  balance  between  the  values  of  the  trust  synergy  and  trust  liability  in  addition  to  their  relative 
magnitudes. 


Definition:  Let  the  characteristic  payoff  function  of  a  trust  game  be  the  difference  between  the  trust  synergy  and  trust 
liability  of  a  coalition  5. 


v(S)  =  s(S)  -  l(S)  (1) 

This  payoff  is  similar  to  the  well-known  constrained  coalitional  game  (CCG)  that  incorporates  gains  from  cooperation 
with  the  costs  due  to  communications  network  restrictions23.  However,  the  characteristic  function  v  in  CCGs  is  defined 
on  the  structure  of  a  particular  communications  network  between  agents,  whereas  the  characteristic  function  for  our  trust 
game  is  defined  only  on  a  set  of  agents.  As  such,  agents  who  are  completely  disconnected  from  communication  with 
other  agents  can  still  theoretically  maintain  membership  in  the  same  trust-based  coalition. 

3.2  Additive  Trust  Game 

Additive  games  are  considered  inessential  games  in  cooperative  game  theory  since  the  value  of  the  union  of  two  disjoint 
coalitions  (5j  n  S2  =  0)  is  equivalent  to  the  sum  of  the  values  of  each  coalition. 

17(5,  U  52)  =  17(5,)  +  v(52)  VS1,S2  c  N  (2) 

In  (2),  we  see  that  the  total  value  of  the  trust  relationships  between  any  two  disjoint  coalitions  must  always  be  zero.  In 
other  words,  the  trust  synergy  between  any  two  disjoint  coalitions  must  always  result  in  a  value  that  is  equal  to  their  trust 
liability.  Thus,  by  expanding  this  definition  for  trust  games  and  rearranging  the  terms,  we  can  characterize  an  additive 
trust  game  as: 


s(S r  U  S2)  -  Z(5,  U  S2)  =  5(5,)  -  Z(5,)  +  s(52)  -  Z(52)  {V51#52  c«:S1nS2  =  0}  (3) 

s(^  U  52)  -  s(St)  -  s(S2 )  =  !(Si  U  52)  -  l(St )  -  Z(52)  {V51#52  c#:S1nS2  =  0}  (4) 

3.3  Constant-Sum  Trust  Game 

In  constant-sum  games,  the  sum  of  all  coalition  values  in  N  remains  the  same,  regardless  of  any  outcome. 

17 (IV)  =  t;(5)  +  v (N\S)  =  k  V5  c  N  (5) 

By  expanding  this  definition  for  trust  games  and  rearranging  the  terms,  we  can  see  that  the  constant-sum  trust  game  is  a 
special  case  of  a  two-coalition  additive  trust  game  involving  every  agent  in  the  game. 

s(N)  -  Z(A)  =  s(5)  -  Z(5)  +  s(N\S )  -  Z(ZV\5)  V5  c  N  (6) 

s(iV)  -  s(5)  -  s(iV\5)  =  l(N)  -  Z(5)  -  l(N\S)  V5  c  N  (7) 


Definition:  An  agent  is  a  dummy  agent  if  the  amount  the  agent  contributes  to  any  coalition  is  exactly  the  amount  that  it 
is  able  to  achieve  alone. 

Theorem  1 :  T  is  a  constant-sum  trust  game  implies  that  Y  is  a  zero-sum  trust  game. 

Proof:  Iff  is  a  constant-sum  game,  then  by  (7),  the  following  constraint  for  singleton  coalitions  must  always  hold: 


s(Ai)  —  s(i)  —  s(N\i)  —  l(N)  —  Z(i)  —  l(N\i )  Vi  £  N  (8) 

By  rearranging  the  terms,  combining,  and  substituting,  we  get: 

s(N)  —  Z(AQ  =  s(t)  —  l(i )  +  s(N\i )  —  l(N\i )  Vi  £  N  (9) 

17  (IV)  =  17  (t)  +  v(N\i )  Vi  £  N  (10) 

17(A)  =  17(A1\i)  Vi  £  N  (11) 


The  result  in  (11)  implies  that  every  agent  in  A  must  behave  like  a  dummy  agent  if  T  is  a  constant-sum  trust  game. 
Since  all  agents  behave  like  dummy  agents  and  v(i)  —  0  for  all  i  £  A,  then  any  coalition  that  forms  in  T  will  have  no 
value.  Hence,  the  value  of  the  grand  coalition  is  zero  (i.e.  v(N )  —  k  —  0).  Therefore,  the  only  possible  constant-sum 
trust  game  is  the  zero-sum  trust  game.  This  completes  the  proof. 

Corollary  1 :  T  is  a  zero-sum  trust  game  if  s(5)  =  ((5)  V5  c  A. 

Proof:  If  s(5)  =  1(5)  VS  c  A,  then  v{S )  =  0  VS  c  A.  Thus,  by  (5),  17(A)  =  v{N\S )  —  k  VS  c  A.  This  result  in 
implies  that  every  possible  coalition  in  A  must  behave  like  a  coalition  of  dummy  agents  in  a  constant-sum  trust  game 
and  their  combinations  with  other  coalitions  will  yield  no  value.  Hence,  the  value  of  the  grand  coalition  is  always  zero 
(i.e.  17(A)  —  k  —  0).  This  completes  the  proof. 

Our  proofs  show  that  any  constant-sum  trust  game  is  necessarily  a  zero-sum  trust  game  that  represents  a  special  case  of 
an  additive  trust  game.  These  facts  reinforce  a  notion  that  a  group  of  agents  who  do  not  trust  each  other  will  always 
prefer  to  work  as  singleton  coalitions.  And  even  if  there  is  some  mutual  trust  between  agents,  gains  from  trust  synergy 
are  always  lost  to  the  trust  liability,  making  it  irrational  to  form  any  coalition  with  any  other  agent.  Thus,  if  one 
determines  that  T  is  a  constant-sum  trust  game,  then  this  provides  immediate  justification  for  using  non-cooperative 
game  theory  as  the  basis  for  modeling  the  purely  competitive  agents  within  the  game  since  there  is  no  payoff  from 
cooperative  activity. 

3.4  Superadditive  Trust  Game 

In  a  superadditive  game,  the  value  of  the  union  of  two  disjoint  coalitions  (S1  n  S2  =  0)  is  never  less  than  the  sum  of  the 
values  of  each  coalition. 


v(Si  U  S2)  >  v(S J  +  v(S2)  VSUS2  c  A  (12) 

This  implies  a  monotonic  increase  in  the  value  of  any  coalition  as  the  coalition  gets  larger. 

5  c  A  c  A  ->  17(5)  <  17(A)  <  17(A)  (13) 

This  property  of  superadditivity  tells  us  that  the  new  links  that  are  established  between  the  agents  in  the  two  disjoint 
coalitions  are  the  sources  of  the  monotonic  increases.  This  results  in  a  snowball  effect  that  causes  all  agents  in  the  game 
to  form  the  grand  coalition  (a  coalition  containing  all  agents  in  the  game)  since  the  total  value  of  the  new  trust 

relationships  between  any  two  disjoint  coalitions  must  always  be  positive  semi-definite.  In  other  words,  the  trust 

synergy  between  any  two  disjoint  coalitions  must  always  result  in  a  value  that  is  at  least  as  large  as  their  trust  liability. 
Thus,  by  expanding  (12)  for  trust  games  and  rearranging  the  terms,  we  can  characterize  a  superadditive  trust  game  as: 

s(S,  U  S2)  -  l(St  U  S2)  >  s(St )  -  KSi)  +  s(S2)  -  l(S2)  {V51(52  c  A:5,  n  52  =  0}  (14) 

s(5x  U  S2)  -  5(5,)  -  s(52)  >  KS,  U  S2)  -  KSJ  -  I(S2)  (V51;52  c  N:S1nS2  =  0}  (15) 

3.5  Convex  Trust  Game 

A  game  is  convex  if  it  is  supermodular,  and  this  trivially  implies  superadditivity  (when  S±  n  S2  =  0).  Thus,  we  see  that 
convexity  is  a  stronger  condition  than  superadditivity  since  the  restriction  that  two  coalitions  must  be  disjoint  no  longer 
applies. 


i7(5i  U  S2)  +  17 (Si  n  S2)  >  17 (SO  +  t7(52)  VS1,S2cN  (16) 

In  convex  games,  the  incentives  of  joining  a  coalition  grow  as  the  coalition  gets  larger.  This  means  that  the  marginal 
contribution  of  each  agent  i  £  N  is  non-decreasing. 

v (5  U  0  —  v(5)  <  v(A  U  0  —  17(A)  whenever  5  c  A  c  N\i  (17) 

Definition:  A  subgame  vR:2R  -7  M,  where  R  £  N  is  not  empty,  is  defined  as  vR(S)  —  v(S)  for  each  5  £  A.  In  general, 
solution  concepts  that  apply  to  a  grand  coalition  can  also  apply  to  smaller  coalitions  in  terms  of  a  subgame. 


Definition:  Given  a  game  T  =  (IV,  v)  and  a  coalition  R  £  N,  the  R-marginal  game  vR :  2N^R  ->  M.  is  defined  by  vR  (S)  = 
v (R  U  5)  —  t7(i?)  for  each  5  £ 

Using  these  definitions,  Branzei,  Dimitrov,  and  Tijs  proved  that  a  game  is  convex  if  and  only  all  of  its  marginal  games 
are  superadditive24.  We  provide  their  proof  here  as  a  means  for  the  reader  to  readily  justify  this  assertion. 

Theorem  2:  A  game  T  =  (N,v)  is  convex  if  and  only  if  for  each  R  E  2N  the  R-marginal  game  ( N\R,vr )  is 
superadditive. 

Proof: 

(i)  Suppose  (N,  v )  is  convex.  Let  R  £  N  and  S1,S2  £  N\R.  Then: 

vr(S i  U  S2)  +  vr(Si  U  S2)  (18) 

=  v (R  USjU  S2 )  +  v(R  U  (5j  n  S2))  —  2v(R) 

=  v((R  U  SJ  U  (R  U  S2))  +  v((R  U  Sj)  n  (R  U  S2))  -  2v(R) 

>  v(R  U  5X)  +  v(R  U  S2)  -  2v(R)  (19) 

=  (v(R  U  5))  -  v(R))  +  ( v(R  U  S2)  -  v(R )) 

=  +  vR(S2 ) 

where  the  inequality  follows  from  the  convexity  of  v.  Hence,  vR  is  convex  (and  superadditive  as  well). 

(ii)  Let  St,S2  £  N  and  R  —  St  n  S2.  Suppose  that  for  each  R  £  2W,  the  game  ( N\R ,  vR)  is  superadditive.  If  R  =  0,  then 

the  game  (Ai\0,  tz0)  =  (N,  v)  and  v(0)  —  0;  hence,  T  is  superadditive.  If  R  A  0,  then  because  ( N\R,vr )  is 

superadditive: 


vR  ((S,  U  S2)\R)  >  vR (5A R)  +  vR {. S2\R )  (20) 

v(S1  U  S2~)  —  v(R)  >  v(S±)  —  v (R)  +  v(S2 )  —  v(R)  (21) 

v(S±  U  S2)  +  v(R)  >  v(S ,)  +  v(S2)  (22) 

v{st  U  S2)  +  v(S1  n  S2 )  >  uCSj)  +  v(S2 )  (23) 


This  completes  the  proof. 

By  using  this  characterization  in  Theorem  2  and  expanding  it  to  our  definition  of  a  trust  game,  we  can  state  a  necessary 
requirement  to  produce  a  convex  trust  game:  that  the  marginal  trust  synergy  between  any  two  coalitions  must  always 
result  in  a  value  that  is  at  least  as  large  as  their  marginal  trust  liability. 

Sr  (( 5 !  u  S2)V?)  -  iR  ((Sx  u  S2)V0  >  SR (SAfl)  -  iR (SAB)  +  (S2 VO  -  (s2y?)  (24) 

(VS1,S2  <z  N:S1  n  S2  =  R} 

sr((.S i  U  S2)\B)  —  —  sr(S2\R )  >  ^((S,  U  S2')\R )  —  (r(S1\R)  —  Ir(S2\R )  (25) 

(VS1,S2  cz  N:S1  r\S2  =  /?} 

Convex  games  are  convenient  due  to  several  nice,  well-known  properties. 

•  The  core  of  a  convex  game  is  never  empty. 


Convex  games  are  totally  balanced,  meaning  that  their  subgames  are  also  convex,  each  with  a  non-empty  core. 


Convex  games  have  a  stable  set  that  coincide  with  its  core. 

The  Shapley  value  of  a  convex  game  is  the  barycenter  of  the  core. 

The  vertices  of  a  core  can  be  found  in  polynomial  time  using  a  polyhedron  greedy  algorithm’5. 


4.  A  PRACTICAL  MODEL  FOR  TRUST  GAMES 

In  the  previous  section,  we  characterized  different  classes  of  trust  games  without  explicitly  defining  a  trust  game  model. 
In  this  section,  we  provide  a  general  model  for  trust  games  that  conforms  to  the  theoretical  constructions  in  the  previous 
section  and  can  be  adapted  to  a  wide  variety  of  applications. 

4.1  Managing  Agent  Trust  Preferences 

The  attitude  of  trustworthiness  agents  have  toward  other  agents  in  a  trust  game  is  managed  in  an  |Ai|  X  |1V|  matrix  T . 


T  =  \t- 

ijl 


\N\*\N\ 


hi  -  1’  i=j 
tij  e  [0,1],  t  *  j 


(26) 


This  matrix  is  populated  with  values  tL j  that  represent  the  probability  that  agent  j  is  trustworthy  from  the  perspective  of 
agent  i.  The  values  tj;-  can  also  be  interpreted  as  the  probabilities  that  agent  i  will  allow  agent  j  to  interact  with  him, 
since  rational  agents  would  prefer  to  interact  with  more  trustworthy  agents. 

The  manner  in  which  ttj  is  evaluated  depends  on  an  underlying  trust  model.  We  make  no  assumption  about  the  use  of  a 
particular  trust  model,  as  the  choice  of  an  appropriate  model  may  be  application-specific.  We  also  make  no  assumption 
about  the  spatial  distribution  of  the  agents  in  a  game  -  therefore,  this  matrix  should  not  necessarily  imply  the  structure  of 
a  communications  graph. 

4.2  Modeling  Trust  Synergy  and  Trust  Liability 

We  provide  a  general  model  for  trust  synergy  and  trust  liability  that  can  be  adapted  for  a  variety  of  applications.  Our 
model  makes  use  of  a  symmetric  matrix  Z  to  manage  potential  trust  synergy  and  a  matrix  A  to  manage  potential  trust 
liability.  Z  is  symmetric  because  we  assume  that  agents  mutually  agree  on  the  benefits  of  a  synergetic  interaction. 


z  = 

K; 

,]  = 

=  0, 

;  =  Oj't  >  0, 

i  =  j 

i  A; 

(27) 

A  = 

k. 

]  =  \Ai‘J 
'J|w|x|w|  (Aj 

:  =  0, 

,•>0, 

i  =i 

i  A  j 

(28) 

As  with  the  T  matrix,  we  make  no  assumptions  about  how  Z  and  A  are  calculated,  since  the  meaning  of  their  values  may 
depend  on  the  application.  For  example,  the  calculations  for  cTjj  and  Aij  between  two  agents  may  not  only  take  into 
account  each  agent’s  individual  intrinsic  attributes  -  it  may  also  factor  in  externalities  (i.e.  political  climate,  weather 
conditions,  pre-existing  conditions,  etc.)  that  neither  agent  has  direct  control  over. 

Definition:  The  total  value  of  the  trust  synergy  in  a  coalition  is  defined  as  the  following  set  function: 

s(S)  =  ^  Wj  tijtj'i  Vi  >  j  (29) 

i,jes 


Trust  synergy  is  the  value  obtained  by  agents  in  a  coalition  as  a  result  of  being  able  to  work  together  due  to  their 
attitudes  of  trust  for  each  other.  The  set  function  s(S)  assumes  that  the  events  “agent  i  allows  agent  j  to  interact”  and 
“agent  j  allows  agent  i  to  interact”  are  independent.  This  is  reasonable  since  agents  are  assumed  to  behave  as 
independent  entities  within  a  trust  game  (i.e.  no  agent  is  controlled  by  any  other  agent).  Therefore,  we  treat  the  product 
tijtji  as  the  relative  strength  of  a  trust-based  synergetic  interaction,  which  justifies  the  use  of  the  summation.  The  value 
for  <7j  j  serves  as  a  weight  for  a  trust-based  synergetic  interaction. 


Definition:  The  total  value  of  the  trust  liability  in  a  coalition  is  defined  as  the  following  set  function: 


KS)  =  ^  2-ijtij  Vi 
i,jes 


(30) 


Trust  liability  can  be  thought  of  as  the  vulnerability  that  agents  in  a  coalition  expose  themselves  to  due  to  their  attitudes 
of  trust  for  each  other.  We  treat  the  product  Ajjty  as  a  measure  for  agent  i’s  exposure  to  unfavorable  trust-based 
interactions  from  agent  j.  A  high  amount  of  trust  can  expose  agents  to  high  levels  of  vulnerability.  But  each  agent  can 
regulate  its  exposure  to  trust  liability  by  adjusting  ty.  Changes  to  ty,  however,  also  influence  the  benefits  of  trust 
synergy. 

4.3  Modeling  the  Trust  Game 

Definition:  From  (1),  we  define  the  trust  game  (also  known  as  the  total  value  of  the  trust  payoff  in  a  coalition)  as  the 
difference  between  its  trust  synergy  and  trust  liability. 

(31) 


(32) 

Vi>j 


The  factorization  in  (32)  shows  us  that  the  first  factor  (t^jtji)  will  always  be  greater  than  or  equal  to  zero  while  the 
second  factor  can  be  either  positive  or  negative.  Hence,  by  isolating  the  second  factor  and  recognizing  that  trust  values 
equal  to  1  produce  the  smallest  possible  reduction  in  the  second  factor,  we  can  state  the  condition  that  guarantees  the 
potential  for  two  agents  to  form  a  trust-based  pair  coalition. 

Proposition  1:  Any  two  agents  i,j  £  N  will  never  form  a  trust-based  pair  coalition  if  at  j  <  Aij  +  Aj  Otherwise,  the 
potential  exists  for  agent  i  and  j  to  form  a  trust-based  pair  coalition. 

Proposition  2:  If  two  agents  can  never  form  a  trust-based  pair  coalition,  then  the  best  strategy  for  both  agents  is  to  never 
trust  each  other  (i.e.  ttj  —  tj ;  =  0). 

In  general,  proposition  1  does  not  extend  to  trust-based  coalitions  larger  than  two  due  to  the  complex  coupling  of  trust 
dynamics  between  different  agents  as  coalitions  grow  larger.  For  example,  two  agents  who  may  produce  a  negative  trust 
payoff  value  as  a  pair  may  actually  realize  a  positive  trust  payoff  with  the  addition  of  a  third  agent.  This  situation  occurs 
if  both  agents  have  positive  trust  relationships  with  the  third  agent  that  outweighs  their  own  negative  trust  relationship. 
Such  a  situation  is  common  in  real  world  scenarios,  and  justifies  the  importance  of  various  trusted  third  parties,  such  as 
escrow  companies,  website  authentication  services,  and  couples  therapists. 

In  light  of  this,  we  can  mathematically  justify  a  condition  similar  to  proposition  1  that  is  valid  for  coalitions  of  any  size  - 
but  only  for  a  special  type  of  trust  game. 

Theorem  3:  A  trust-based  coalition  S  £  N  will  never  form  if: 


Z  < 

i,jES 

Vi>j 


Vi^j 


{Vi,j  £  5:  ti  jtj  i  =  k } 


(33) 


Proof:  Let  S  £  N  and  Lyty;  =  k  for  all  i,j  £  S.  Then,  by  substituting  k  into  (31): 


ijES  ijES  J,L 


Vi>j 


Vi±j 


\ 


u(S)  =  k 


1^-rt 

ijES  i,jES  J,L 

\vi>j 


ijES 

Vi*/ 


J 


(34) 


(35) 


Because  k  is  a  constant  that  is  always  greater  than  or  equal  to  zero,  we  can  clearly  see  that  the  second  factor  affects 
whether  or  not  v(S)  is  positive  or  negative.  Hence,  if  the  second  term  in  the  second  factor  is  larger  than  the  first  term, 
then  a  coalition  S  will  never  form.  This  completes  the  proof. 

4.4  Incorporating  Context  into  a  Trust  Game 

In  practice,  trust  is  often  defined  relative  to  some  context.  Context  allows  individuals  to  simplify  complex  decision¬ 
making  scenarios  by  focusing  on  more  narrow  perspectives  of  situations  or  others,  avoiding  the  potential  for 
inconvenient  paradoxes. 

Coalitional  trust  games  can  also  be  defined  relative  to  different  contexts  using  the  multi-issue  representation26,  where  we 
use  the  words  “context”  and  “issue”  interchangeably. 

Definition:  A  multi-issue  representation  is  composed  of  a  collection  of  coalitional  games,  each  known  as  an  issue, 
(Ai1;  rq),  ( N2 ,  v2),  ,  ( Nk ,  vk ),  which  together  constitute  the  coalitional  game  ( N ,  v)  where 

•  N  -  N±  U  N2  U  U  Nk 

•  For  each  coalition  S  £  N,  v(S )  =  £f=1  vt(S  n  Nt) 

This  approach  allows  us  to  define  an  arbitrarily  complex  trust  game  that  can  be  easily  decomposed  into  simpler  trust 
games  relative  to  a  particular  context.  A  set  of  agents  in  one  context  can  overlap  partially  or  complete  with  another  set 
of  agents  in  another  context.  And  one  can  choose  to  treat  the  coalitional  game  in  one  big  context,  or  the  union  of  any 
number  of  contexts  based  on  some  decision  criteria. 


5.  APPLYING  A  TRUST  GAME  TO  UNMANNED  COOPERATIVE  CONTROL 

In  this  section,  we  apply  a  coalitional  trust  game  in  a  specific  unmanned 
cooperative  control  application:  the  unmanned  military  convoy.  Currently, 
the  United  States  Army  Tank  Automotive  Research,  Development,  and 
Engineering  Center  is  funding  the  Convoy  Active  Safety  Technology 
(CAST)  program,  which  aims  to  improve  convoy  operations  with  the 
installation  of  a  small  kit  in  the  cab  of  a  tactical  vehicle27.  The  kit  connects 
actuators  to  the  steering  wheel,  gas  pedal,  and  brake  pedal,  and  uses  various 
sensors,  such  as  RADAR,  LIDAR,  and  electro-optical/infrared  cameras,  to 
sense  a  vehicle’s  environment  and  safely  drive  the  vehicle.  Our  goal  with 
the  trust  game  is  to  understand  how  trust-based  coalitions  will  form  under 
different  attitudes  of  trust  in  a  convoy  scenario. 

We  begin  with  a  simple  convoy  scenario  that  models  a  four-vehicle 
convoy,  N  —  {1,2, 3, 4],  which  intends  to  move  together  in  a  single  file. 

The  value  of  each  index  into  N  represents  the  vehicle’s  position  in  the 
convoy.  For  this  scenario,  we  interpret  the  trust  synergy  in  coalition  to  represent  the  vehicles  in  the  coalition  moving 
forward.  Thus,  we  set  the  values  in  the  trust  synergy  matrix  £  equal  to  the  number  of  vehicles  that  will  move  forward  if 
the  two  vehicles  are  moving  forward  (inclusive  of  the  two  vehicles).  We  interpret  the  trust  liability  in  coalition  to 
represent  the  vulnerability  of  vehicles  in  the  coalition  to  stop  moving.  Thus,  we  set  the  values  in  the  trust  liability  matrix 


K  4 


Tactical  wheeled  vehicles  equipped 
with  Convoy  Active  Safety 
Technology  (CAST) 


A  equal  to  the  number  of  vehicles  can  prevent  a  particular  vehicle  from  moving  forward  in  a  vehicle  coalition  pair.  Note 
that  in  a  more  realistic  unmanned  convoy  trust  game,  the  values  in  I!  and  A  could  be  based  on  additional  factors,  such  as 
the  presence  of  hostile  forces,  the  smoothness  of  the  road,  the  time  of  day,  weather  conditions,  vehicle  reliability,  or 
mission  importance. 

Definition:  The  values  in  I!  and  A  for  a  4-convoy  trust  game  are: 

0  2  3  4  1  [0  0  0  0]  (36) 

2  0  3  4  1  0  1  1 

3304  2202 

.4  4  4  0  [3  3  3  0. 

First,  let  us  analyze  this  game  as  an  additive  trust  game.  While  there  are  infinitely  many  solutions  for  T  that  conform  to 
(4),  the  most  obvious  solution  is  the  extreme  situation  where  no  vehicle  trusts  any  other  vehicle  -  or,  when  T  is  the 
identity  matrix  ( T  —  I).  In  this  case,  it  can  clearly  be  seen  from  (31)  that  no  vehicle  will  ever  affect  another  vehicle, 
either  positively  or  negatively.  Thus,  each  vehicle  will  ultimately  form  a  singleton  coalition  and  fail  to  work 
cooperatively  with  any  other  vehicle. 

Next,  let  us  analyze  another  extreme  situation  where  every  vehicle  completely  trusts  every  other  vehicle  -  or,  when 
T  —  [1]4X4.  As  such,  we  can  enumerate  the  trust  payoff  values  for  each  possible  coalition. 

v({l,2})  =  1;  v({l,3})  =  1;  v({l,4})  =  1;  v({2,3})  =  0;  v({2,4})  =  0;  v({3,4})  =  -1;  (37) 

v({l,2,3})  =  2;  v({l,2,4})  =  2;  v({l,3,4})  =  1;  v({2,3,4})  =  -1;  v({l,2,3,4})  =  2; 

The  results  in  (37)  provide  us  an  interesting  insight,  in  that  all  vehicles  behind  the  lead  vehicle  find  higher  values  of  trust 
payoff  with  the  lead  vehicle  than  with  the  nearest  vehicle.  As  such,  as  long  as  the  lead  vehicle  is  a  member  of  a  trust- 
based  coalition  in  this  game,  there  will  be  no  incentive  for  any  other  vehicle  to  abandon  the  coalition.  Thus,  the  vehicles 
ultimately  form  the  grand  coalition.  Note,  however,  that  the  formation  of  a  grand  coalition  does  not  imply  that  the  trust 
game  is  superadditive  or  convex.  This  assertion  is  justified  with  the  observation  that  v({3,4})  £  t?({3})  +  v({4})  =  0. 

In  order  to  form  a  convex  4-convoy  trust  game,  we  must  satisfy  the  conditions  in  (25),  which  ensure  that  all  trust  payoff 
values  in  any  coalition  are  at  least  large  as  any  sub-coalition.  While  there  are  infinitely  many  solutions  for  T  that 
conform  to  (25),  the  games  with  the  highest  trust  payoff  have  either  one  of  the  following  trust  matrices: 

[11111  [11111  [11111  [11111  (38) 

110  0  1101  1110  1111 
1  1010  2  1010  3  1110  4  1110 
.1  0  0  1  I1101J  I1001J  [1101. 

7j ,  T2,T3,  and  T4  are  modified  versions  of  [1]4X4  and  all  produce  the  same  results  in  the  trust  payoff  value  function.  The 
main  modification  ensures  that  vehicles  3  and  4  have  no  trust  toward  each  other  since  the  trust  liabilities  between  them 
always  outweigh  their  trust  synergies.  The  following  is  the  enumeration  of  the  trust  payoff  values  for  the  4-convoy  trust 
game  with  the  highest  trust  payoff: 

v({l,2})  =  1;  v({l,3})  =  1;  v({l,4})  =  1;  t?({2,3})  =  0;  v({2,4})  =  0;  t?({3,4})  =  0;  (39) 

v({l,2,3})  =  2;  v({l,2,4})  =  2;  v({l,3,4})  =  2;  v({2,3,4})  =  0;  v({l,2,3,4})  =  3; 

The  deep  insight  we  gain  from  analyzing  (38)  and  the  results  in  (39)  is  that  all  vehicles  behind  the  lead  vehicle  need  only 
trust  the  lead  vehicle  in  the  convoy  to  move  forward,  provided  the  lead  vehicle  trusts  every  other  vehicle  to  follow  it. 
This  echoes  the  intuition  seen  in  Jean-Jacques  Rousseau’s  classic  “stag  hunt”  game,  where  there  is  no  incentive  for  any 
player  to  cheat  by  not  cooperating  as  long  as  each  player  can  trust  others  to  do  the  same.  This  type  of  game  differs  from 
the  well-known  “prisoners’  dilemma”  game,  where  the  dominant  strategy  is  to  confess  and  not  cooperate  with  any  other 
player28. 


Personal  experience  suggests  that  drivers  in  convoy-like  traffic  patterns  rarely  place  large  amounts  of  trust  in 
neighboring  drivers,  as  our  model  corroborates.  In  the  event  a  driver  becomes  stuck  in  a  giant  traffic  jam,  he  likely  will 
not  feel  betrayed  by  the  driver  directly  in  front.  Instead,  he  will  unconsciously  begin  gauging  the  coalitional  value  of  the 
traffic  jam  by  considering  his  level  of  trust  in  the  lead  driver  in  the  traffic  jam,  whether  in  visible  range  or  not.  In  most 
cases,  the  driver  monitors  the  traffic  flow  or  listens  to  traffic  reports  to  gauge  his  trust  for  the  lead  driver.  He  may  also 
unconsciously  consider  other  drivers  in  the  traffic  jam  and  estimate  their  trust  perceptions  of  the  traffic  jam  to  gauge  the 
coalition’s  value.  In  the  event  a  driver  cannot  accurately  gauge  the  value  of  the  traffic  jam,  he  may  choose  to  leave  the 
traffic  jam  and  attempt  to  join  another  traffic  coalition  with  a  higher  payoff  value.  These  types  of  driver  behaviors  are 
generally  not  performed  when  the  trust  for  the  lead  driver  to  move  forward  is  high.  Yet,  these  behaviors  feel  necessary 
when  the  trust  lessens  since  they  attempt  to  resolve  coalitional  or  environmental  uncertainties. 

For  unmanned  military  convoys,  our  results  suggest  that  follower  vehicles  need  only  communicate  with  the  lead  vehicle 
to  ensure  trustworthy  cooperation.  The  lead  vehicle  needs  only  to  broadcast  pertinent  information  to  the  followers,  and 
the  followers  need  only  to  acknowledge  receiving  the  information  from  the  lead  to  signal  agreement.  This  hub-and- 
spoke  communications  network  would  therefore  foster  the  reciprocity  necessary  to  cultivate  trust  between  the  leader  and 
its  followers  while  also  keeping  the  computational  complexity  of  the  network  to  a  minimum  of  O(n).  The  presence  of 
the  solution  T4  suggests  that  trust-based  redundancy  can  be  achieved  with  the  second  vehicle  in  the  event  of  a 
catastrophic  failure  to  the  lead  vehicle.  The  cost  of  the  trust-based  redundancy  would  require  an  additional  (|Ai|  —  2) 
point-to-point  connections,  but  the  computational  complexity  would  not  change. 

We  conclude  this  section  by  generalizing  the  convoy  trust  game  for  any  number  of  vehicles  and  prove  the  solution  for 
the  highest  payoff  trust-based  coalition.  Our  proof  shows  that  all  vehicles  behind  the  lead  vehicle  in  a  convoy  need  only 
trust  the  lead  vehicle,  and  no  other  vehicle,  to  move  forward  so  long  as  the  lead  vehicle  trusts  every  other  vehicle  to 
follow  it. 

Definition:  The  values  in  2!  and  A  for  a  convoy  trust  game  with  |Ai|  vehicles  are: 
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Theorem  4:  The  convoy  trust  game  that  produces  the  grand  coalition  with  highest  payoff  value  has  a  trust  matrix  that 
conforms  to  the  following  construction: 


T  =  \t- 
L  1.7  J 
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'hi  =  1>  i=j 

hj  =  1-  t  ^  j,  min({t,y'})  =  1 

hi  =  tiX  £  (O'1)'  1  *  h  min({i  J})  =  2 

tij  =  0,  i  ^  ;,min({i,;})  >  2 


(42) 


Proof: 

Suppose  we  generalize  the  values  in  2  and  A  according  to  (40)  and  (41),  respectively.  According  to  proposition  1,  two 
agents  i,j  £  N  will  never  form  a  trust -based  coalition  pair  if  <7y  <  Ay  +  Aj  Thus,  by  substitution: 


max({i,;})  <  (i  -  1)  +  (j  -  1) 


(43) 


max({i,/})  <  i  +  j  —  2 


(44) 


We  see  that  if  i  is  the  maximum  value,  then  0  <  j  —  2.  Similarly,  if  j  is  the  maximum  value,  then  0  <  i  —  2.  Thus,  the 
inequality  in  (44)  tells  us  that  any  vehicle  behind  the  second  vehicle  will  never  form  a  trust-based  coalition  with  any 
other  vehicle  behind  the  second  vehicle.  Therefore,  by  proposition  2,  the  best  strategy  for  these  vehicles  is  to  have  no 
trust  for  each  other;  hence  ty  =  0  when  min({i,/})  >  2  for  i  A  j . 


Since  the  result  in  (44)  implies  that  trust-based  coalition  formation  is  possible  with  the  lead  vehicle  and  the  second 
vehicle,  we  must  analyze  the  trust  payoff  values  for  coalitions  with  these  vehicles.  Using  (32)  and  our  definitions  in  (40) 
and  (41),  the  trust  payoff  values  for  a  coalition  in  the  convoy  trust  game  is: 


v(S)  =  ^  tytj'i  (  max({i,;'}) 
i.jes  ' 

Vi>; 


i~  1  j~ A 

tj.i  ti.j  ) 


From  (45),  we  define  trust  payoff  values  for  any  pair  of  vehicles  as: 


|ma  x({i,y'}) 


j~ A 

tj.i  ti.j  ) 


(45) 


(46) 


Let  us  first  analyze  coalition  formation  with  the  lead  vehicle.  If  i  =  1,  then  max({t,7'})  =  j.  Therefore,  the  payoff  value 
for  a  pair  coalition  between  i  and  j  is: 


KUu'})  =  hjtj,!  [j 

KUJ})  =  ~  jtj,i  +  ty,! 

KUJ))  =  tj.iOhj  -j  + 1) 


(47) 

(48) 

(49) 


The  result  in  (49)  show  that  the  highest  trust  payoff  value  is  achieved  when  both  the  lead  vehicle  and  any  other  vehicle 
completely  trust  each  other  (i.e.,  when  t1;-  =  tjA  =  1).  However,  to  justify  this  assertion,  we  must  also  show  this  is  true 
when  j  —  1.  If  j  =  1,  then  max({i,  j})  =  i.  Therefore,  the  payoff  value  for  a  pair  coalition  between  i  and  j  is: 

(50) 


t7({i,l})  =  t^Ai 


Ll,i 


v({i,  1})  =  ituitu  -  itui  +  tui 
v({i,  1})  =  tui(itu  -  i  +  l) 


(51) 

(52) 


Both  (49)  and  (52)  confirm  that  the  highest  trust  payoff  is  achieved  when  both  the  lead  vehicle  and  any  other  vehicle 
completely  trust  each  other.  Therefore,  j  =  1  when  the  min({i,  j})  =  1  for  i  ^  j. 

Now,  we  analyze  coalition  formation  with  the  second  vehicle.  If  i  =  2,  then  max({i,7'})  =  j.  Therefore,  the  payoff 
value  for  a  pair  coalition  between  i  and  j  is: 


v({2 ,;})  =  t2Jtji2  (j 

\  Zj,  2  C2  ,j  ) 

v({2 ,;'})  =  t2Jtj-2J  -  t2J  -jtj2  +  tj2 
v({2 ,;'})  =  tJi2(jt2J  -  t2J 


(53) 

(54) 

(55) 


The  highest  trust  payoff  that  can  be  achieved  with  the  second  vehicle  is  equal  to  zero,  and  this  only  occurs  when  both 
vehicles  either  have  complete  trust  in  each  other  (i.e.,  when  t2  j-  =  tj  2  —  1)  or  no  trust  in  each  other  (i.e.,  when  t2;-  = 
tj  2  —  0).  Any  other  combination  of  trust  values  will  produce  negative  trust  payoff  values.  However,  to  justify  this 


assertion,  we  must  also  show  this  is  true  when  j  —  2.  If  j  —  2,  then  max({i,y})  =  i.  Therefore,  the  payoff  value  for  a 
pair  coalition  between  i  and  j  is: 


v({i,  2})  =  tii2t2X  ( i  -  l-—^-  -  ] 

\  r2  ,i  zi,2j 

v({i,  2})  =  iti2t2i  -  iti2  +  ti2  -  t2i 

t7({i,2})  =  ti2(it2i  -  i  +  l)  -  t2i 

Both  (55)  and  (58)  confirm  that  the  highest  trust  payoff  that  can  be  achieved  with  the  second  vehicle  is  equal  to  zero. 
Therefore,  ttj  =  tj  i  £  {0,1}  when  min({i,y'})  =  2  for  t  A  j.  To  complete  the  proof,  we  simply  state  our  assumption  that 
each  vehicle  fully  trusts  itself,  since  it  is  impossible  for  a  vehicle  to  diverge  from  a  singleton  coalition.  Therefore, 
ti  j  —  1  when  i  —  j.  This  completes  the  proof. 


(56) 

(57) 

(58) 
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